Algorithmic complexity and entanglement of quantum states 
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We define the algorithmic complexity of a quantum state relative to a given precision parameter, 
and give upper bounds for various examples of states. We also establish a connection between the 
entanglement of a quantum state and its algorithmic complexity. 
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Algorithmic information provides a concise notion of 
complexity, or randomness, for individual classical ob- 
jects. It is measured by the length of the shortest com- 
puter program that produces a faithful image of the ob- 
ject, usually represented as a string of binary numbers 
LJ This notion of complexity has not only added a 
new perspective to abstract areas such as mathematical 
proof theory (GodePs theorem) Q but it has also been 
applied successfully to a range of problems in thermody- 
namics. Examples are the Maxwell demon paradox 0,0, 
and the treatment of irreversibility in classical chaotic 
systems 0,0. 

Quantum theory has changed our conception of phys- 
ical objects, whose states are described as vectors in a 
Hilbcrt space. For composite objects, this leads to the 
fundamental property of quantum entanglement, which 
cannot be explained by any classical theory. A consis- 
tent discussion of the thermodynamics of systems that 
are monitored by quantum information processing de- 
vices should therefore be based on an appropriate defini- 
tion of the algorithmic complexity of quantum states. 

In this paper, we propose a definition for the algo- 
rithmic complexity of a quantum state that depends on 
a given precision parameter, and give upper bounds on 
complexity for various examples of states. We also estab- 
lish a connection between the entanglement of a quantum 
state (in terms of its Schmidt measure and its algo- 
rithmic complexity. Earlier proposals for the algorithmic 
complexity exist, which are based either on the repro- 
ducibility of a quantum state via Turing machines 0, [l(j 
or on universal probability ^lj • 0m proposal is based on 
the idea that each quantum state is ultima tely identified 
with an experimental preparation process |l2 | . The def- 
inition of the algorithmic complexity of a quantum state 
is thus naturally reduced to the description complexity 
of its (abstract) preparation process. A similar approach 
has been introduced in 0] m the analysis of relations 
between computation complexity and entanglement. 

To motivate our definition of the algorithmic complex- 
ity of a quantum state, we consider the following sce- 
nario. Alice has created a certain quantum state in her 
laboratory and wants to describe this state to Bob, who is 
supposed to reproduce it in his laboratory. How difficult 
is it for Alice to describe to Bob the state of her system? 
In order to answer this question we may distinguish the 
two situations in which Alice and Bob communicate via 



a classical or a quantum channel. In the latter case, Al- 
ice may send to Bob the quantum state altogether (or in 
some Schumacher compressed form) |l4j . If the commu- 
nication is classical, this is not possible. On the other 
hand, as a quantum state can be regarded as the result 
of some experimental preparation procedure, Alice may 
choose to send to Bob the latter. In this case, the com- 
plexity of a quantum state is identified, in a very natural 
way, with the description complexity of an experimental 
preparation procedure [l5|. 

Even though the first approach may seem "more quan- 
tum" , it lacks of an important feature that we usually as- 
sociate to the description of an object. Even if Bob has 
the state sent by Alice, he might not know what state 
he has received. In this paper, thus, we shall follow the 
second approach and identify the algorithmic complexity 
of a quantum state with its preparation complexity i.e. 
the classical description complexity of the preparation 
procedure. 

To be able to communicate, Alice and Bob must first 
have agreed on a common language which they are us- 
ing to describe their preparation procedure. Ideally, they 
will also use the same "toolbox" to compose their exper- 
iments and the same words when referring to elements 
of this toolbox. The toolbox is in general an abstrac- 
tion from any real experimental scenario: in quantum 
information theory such an abstraction leads to defin- 
ing the toolbox by a set of elementary operations on a 
Hilbcrt space with a given tensor-product structure and 
dimension. In particular such toolbox will include the 
ability to prepare some standard reference state, and a 
finite set of elementary operations. A complete prepara- 
tion procedure is then described as a sequence of unitary 
transformations and possibly measurements applied to 
the reference state. 

In classical information theory, the algorithmic com- 
plexity of an objects measures the amount of information 
necessary to reproduce it. The Kolmogorov complexity 
Kci of a binary string us is defined as the length of the 
shortest program that, running on a universal Turing ma- 
chine, gives oj as output. We stress that algorithmic com- 
plexity takes in account only the length of the program 
(and thus the length of the description of the object) and 
not the time needed by the computer to actually run the 
program. This last quantity is instead studied by the 
computational complexity and is related to a different 
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property of objects, that is their logical depth [l6[ . 

It is always possible to reproduce a string u) = 
ui^uJiz ■ ■ ■ by means of a program of the form: 11 write 
w,j u>i 2 ■ ■ ■ " . This implies that the length of a string 
constitutes (up to a constant) an upper bound for the 
complexity of the string itself: KQ\(u) n ) < l(u: n ) = n 
(T?| . Naturally there are sequences for which this up- 
per bound is far too large: the complexity of a periodic 
string, for example, grows only logarithmically with the 
length of the sequence. A string is said to be complex 
(or structureless, or random) if its algorithmic complex- 
ity grows linearily with its length: these are the strings 
typically generated by random sources (e.g. a coin toss). 

Considering that a quantum state can be characterized 
by a sequence of elementary operations (represented e.g. 
as a "circuit"), we define the complexity of a state re- 
ferring to that of the circuit itself. A finite set of gates 
(constituting a complete gate basis) is suitable to prepare 
any state up to an arbitrary precision. Through an ade- 
quate coding, the circuit is reduced to a (classical) string 
whose Kolmogorov complexity is well defined and which 
can be associated to the original state. In this way the 
algorithmic complexity of a state satisfies the intuitive 
idea of complexity as a measure of "how difficult" it is 
to prepare a state. Since with a finite number of gates 
only a countable set of states can be prepared exactly, it 
is necessary to introduce a precision parameter in such 
definition. 

From now on we represent with Qn the space gen- 
erated by N qubits and with |0)jv G Qn the vector 
|0}jv = 10)®^, where each |0) is an element of the com- 
putational basis {|0), |1)} of a single-qubit Hilbert space. 
We represent with C|0)tv the result of the application 
of a circuit C on the state \Q)n', if l(y|C|0)jv| 2 > 1 — £ 
we will say that C prepares \ip) with precision e (where 
< e < 1). We say that two states \ip) and \tf>) are 
e- distinguishable if K^ip)! 2 < 1 — £. 

Once we fix a complete gate basis B and a code O, 
the procedure to compute the algorithmic complexity of 
state is the following. 

1. With the gates contained in the basis B, build a cir- 
cuit C B ' £ that prepares \ip) with precision e. 

2. Code the circuit, obtaining a classical sequence 
uj n {C B - e ) = wg ■ ■ ■ uf m of symbols wg = wg (C B ' e ) G fi . 
The algorithmic complexity of a state, relative to the 
basis B, the code fl and the circuit C B , with precision 

parameter e is: fiB '' (|y>» = K cx {u a {C B *)) . 

3. In general there are more circuits that prepare the 
same state \ip), and in principle the corresponding com- 
plexities can be different. In order to define a property 
of the state itself (and not related to the circuit used to 
reproduce it) we minimize over all of them. 
Definition. The algorithmic complexity of the state \tp), 
relative to the code £1 and the gate basis B, with precision 
parameter e is: 

A^f' 6 (|^» = min <;f cB ' e (|^)) (1) 



where C ■ is the set of all the circuits built with gates 
from B that prepare \ip) with precision £. 

Considering that the choice of code and basis is arbi- 
trary, it is necessary to study how it influences the com- 
plexity of the state. It is also relevant to consider how the 
complexity of a quantum state depends on the precision 
with which we are required to reproduce it. 

Dependence on the code. If and fl are two dif- 
ferent codes, then, for any state \tp) and any precision 
parameter e: K^' B ' e (\<p)) = K^' c B ' e (\tp)) + fc a n , where 
/cn,n is a constant that depends only on Q and f2. 
is the length of a "dictionary" with which it is possible 
to translate the description made using one code to that 
made using the other. Since both codes are finite, such 
dictionary is finite too and, in the limit of big values of 
K^' B ' £ (\(p)), its contribute is negligible. Considering this 
codc-invariance property we can omit explicitating the 
dependence on the code (we can imagine fixing it once 
and for all) and write simply: -K" N 'f (|v)) • 

Complexity and precision. Let us consider now 
how the complexity of a state depends on the precision 
parameter. It has been shown [l^ that using only the set 
of all 1-qubit gates, plus the controlled not, it is possi- 
ble to reproduce any unitary operation U over Qn using 
O (i N ) gates. However, if one is interested in reproduc- 
ing the action of a unitary operation on one particular 
(given) state, only O (2 N ) such gates are sufficient. Thus, 
to prepare any state \<p) from the given initial state |0) jv 
we need at most O (2 N ) g ates. We consider now the 
Solvay-Kitaev theorem [l9l | which implies that any cir- 
cuit acting on Qjv built with to 1-qubit and G gates and 
can be reproduced up to precision e using O (to log c ( — )) 
gates from a finite gate basis (c G [1,2] is a constant 
whose exact value is not yet known). It follows that the 
action of any unitary transformation on |0)jv can be im- 
plemented (and thus any \ip) £ Qjy can be prepared) up 
to precision e via a circuit built with gates from any finite 
and complete basis; futhermore, the number of gates in 
such a circuit is M ~ 2 N log | . 

The length of the string that codes the circuit grows 
linearly with the number of gates of the circuit itself: to 
code a circuit that prepares a general state \tp) g Qn we 
need thus a sequence whose length is (proportional to) 
M. From what seen above we then have: 

K*£Q<p) G Q N ) < 2 N bgi . (2) 

We notice that this bound is much higher than the 
classical one, where the complexity grows at most linearly 
with the number of bits of the string. Intuitively this 
reflects the fact that the space of quantum objects is 
much richer than that of classical ones. In the last part 
of this work we will also see that such difference can be 
explained by quantum entanglement. 

Dependence on the basis. The definition of the 
algorithmic complexity of a state has a dependence on 
the choice of the basis. Given any state \<p) there always 
exists a particular basis using which the preparation of 
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\ip) is trivial. If Alice wants to describe to Bob a state 
and they have previously agreed on using a certain gate 
basis, then Alice has only to describe the circuit (passing 
the sequence <jJc)- If they have not agreed on a partic- 
ular gate basis, then Alice could indeed build a circuit 
using the "best" basis, but in this case she would have 
to describe the basis itself to Bob, and this would be a 
similarly difficult task |2Cj . 

One might nevertheless wonder whether there is some 
particular basis that can describe all (or almost all) states 
with simple circuits. If such a basis existed it would 
obviously be convenient for Alice and Bob to agree on 
using that and (almost) all states would be non-complex. 
In the following we show that such a basis cannot exist as, 
once any gate basis is fixed, the number of non-complex 
states is small in relation to the total number of states. 

In classical information theory it is known that the 
number of compressible (bit) strings is "small" ; more 
precisely the ratio between the strings with complexity 
smaller than a constant k and the total number of n-bit 
strings is bound by (2 k — 1)2~" . 

As we have seen in the previous paragraphs, once we 
fix a basis B and a precision parameter e, we can asso- 
ciate to every quantum state \ip) a (2 N log §)-bit string 

Ljf (\<p)) whose classical algorithmic complexity coincides 
with the complexity of \ip). The result seen above for 
classical bit strings can thus be generalized to quantum 
states and one finds that the ratio between compressible 
quantum states (such that Kf{\y>)) < k) and the total 
number of ^-distinguishable normalized states is bound 
b y 2 2JVl °g £ (2 fc - 1) ~ 2 2 ™ loge+fc . Such a relation holds 
true also in the case when k = k(N,e) is a function. 
State | (p) will be non-complex only if its complexity is 
0(2^ log i): this means that the right member of the 
inequality becomes^ 2 ™ io s^+o(2 N log ±) _ 2 2 " lo % E < 1. 
Thus, one obtains that for any fixed basis B, the number 
of non-complex states is exponentially small [2lJ . 

Note that there are cases in which the complexity is in- 
variant for basis choice. This happens, for example, when 
we consider a coarsening of the gate basis, that is if wc 
consider two gate bases B and B_, one of which (B_) con- 
stituted of gates that can be built with gates from B (e.g. 
B_ containes a Toffoli gate, while B contains Hadamard 
and C-not). In this case, any circuit made by gates from 
B_ can be reproduced by one made by gates from B. The 
string that codes this circuit will in general be longer 
than that of the original circuit, but their complexities 
will change only for a (small) constant ks,B (that repre- 
sents the length of a "dictionary" between the two gate 
bases). 

From a less abstract point of view, this property trans- 
lates into a form of invariance with respect of the choice 
of the experimental apparatus. It is not required that the 
circuit be actually built only with the elementary gates: 
the use of more complex components does not modify the 
complexity of the description as long as they are them- 
selves composed of elementary parts. 



Entanglement and complexity. The nature of 
quantum correlations has been a central issue of long- 
lasting debates on the interpretation of quantum mechan- 
ics. In the last years, the notion of entanglement has been 
recognized as central to quantum information processings 
|23j . As a result, the task of characterizing quantum en- 
tanglement, and the properties related to it, has emerged 
as one of the prominent themes of quantum information 
theory. In the last part of this letter we investigate the 
relations between the algorithmic complexity of a state 
and its entanglement properties. 

Let us begin by considering the case of a J-separable 
state \ip) G Qn of the type: \ip) = <S>'' =1 \<Pj), with \<pj) <G 

Qnj, dim(Q JV ,) = 2^, and £/=i N, = N . State \ip) is 
not totally entangled, as it can be written as the tensor 
product of other (possibly entangled) states \(pj) (with 
K n ^(\(fj)) < 2 Nj log-). As a consequence of this fact 

we have: K*£(\<p)) < £/=i K^ J {\^)) < 2 N log i, 
where we have used the fact that \ip) is prepared with 
precision e if all states \ipj) are prepared with precision 
e/J [2i|. Given any J > 1, thus, there exist (J — In- 
separable states whose complexity is larger than that of 
any J-separable state. 

Thus, the maximal complexity can be obtained only 
by a truly A^-party entangled state (in the sense that it 
cannot be written as tensor product of states contained 
in subspaces of Qn)- We stress that this consideration 
does not imply that all totally entangled states have max- 
imal complexity. Counterexamples are given by W, GHZ, 
and ./V-qubit graph states [2^| . The latter are highly en- 
tangled, but nevertheless their complexity is bound by 
N 2 log -j [23| • As another example let us consider a state 
\ip) G Qn of the form \<p) = ®f =1 \ipj), \ipj) G Qi- In 
this case wc have: K*£(\<p)) < J2jLi K Net /N Qw)) ^ 
2N log y . Thus the complexity of a separable state can 
grow only at most linearly with the number of qubits. 

The relation, illustrated by the examples above, be- 
tween complexity and entanglement can be formalized if 
we choose the Schmidt measure Q as a measure of entan- 
glement. Given a quantum state |$) G Qn, its Schmidt 
measure Es(]tp}) is defined as the logarithm of the min- 
imum number r of separable states \<pi) G Qn such that 
1$) = Yh=i a i\<P%) G Qn- In the following, we show how 
the knowledge of the Schmidt measure of a quantum state 
|$) allows us to give an upper bound on its complexity. 

In order to do this we specify a circuit that prepares 
1$). The general idea is to compose such a circuit "us- 
ing" the circuits that prepare the states \<fi) that appear 
in the decomposition of |$). Such a circuit is built with 
the aid of logr "ancilla" qubits, initially prepared in the 
superposition state \a) = J~]j—n <^iK) (where \i) is the 
state whose binary representation gives the state of the 
logr qubits). We then apply to the initial state |0) a 
circuit consisting of controlled-C^d <£>;)) (in series), the 
application of each conditional on the ancilla being in 
state \i). The last step is to project the ancilla on state 
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ELi \i)/V* = ®7ii r (|0)i + |l)i)/V2: state |$) is pre- 
pared if the result is non-zero. If this is not the case, 
it is sufficient to repeat the procedure from the begin- 
ning [2(j . The complexity of the state |$) can now be 
expressed in terms of the complexity of the ancilla state 
| a) and of that of the remaining circuit. 

The ancilla can in principle be any state of log r qubits; 
from what was seen in the above sections we have thus: 
K^l(\a)) < 2 lo s r logi = rlogi. Once the ancilla is 
prepared in the required state, it is necessary to describe 
the remaining circuit. First of all we must describe the 
individual circuits Cf(\(pi)) (and this requires a number 
of bits bounded by the sum of the complexities of the 
single states \<fii)). Performing each of these circuits as 
a controlled operation requires additional O(logrlogi) 
gates from B. We thus have: 

K*£(\<Z>))<3N2 E ^»\og± , (3) 

where we have used the fact that, as the states \ipi) are 
separable, their complexity is bound by 27V log |. 
Note that this result includes the two particular cases 
treated previously. If |<I>) is separable, in fact, we have 
Es(\&)) = 0, and the equation above takes the form: 
^Net(l*» < 37V log i. Alternatively, when the state |$) 
is truly entangled, with Schmidt measure logr = N, we 

have if^et < 2mN lo S i ~ 2N lo S \ ( U P to a P ol y- 
nomial term). 

The notion of complexity descibed in this letter can 
be extended to mixed quantum states. Given a state 
p its algorithmic complexity is defined as K^ t {p) = 
min nj-^Not (l ( ^))] Ai ' wnere the minimum is taken over 



all pure state mixtures such that p — J^. Ai \ipi) (ipi \ . Thus 
the complexity of a mixed state is the average complex- 
ity of the states that appear in its (optimal) mixture. 
The choice of the geometric average is dictated by the 
necessity of giving an adequate weight to the probability 
distribution. Such a definition coincides with the one we 
have introduced in this paper in the pure state case. Fur- 
thermore one finds that the relationship between entan- 
glement and complexity also holds. In particular wc have: 
K Net ~ 37V2 Es ^ log i, where E s {p) is the Schmidt mea- 
sure of the mixed state p as defined in Q ■ 

In this paper we have introduced a new notion of algo- 
rithmic complexity of a quantum state, based on the clas- 
sical description of its preparation procedure. Wc have 
seen how the complexity of a quantum state grows, in 
general, exponentially with the number of qubits and this 
is significantly different from the algorithmic complexity 
of classical objects (where the upper bound is linear with 
the number of bits). In the last part we have shown how 
this difference can be interpreted as a consequence of the 
presence of quantum correlations, by giving a bound on 
the complexity of a state in terms of its entanglement. 
A consequence of this is that the absence of entangle- 
ment (i.e. in completely separable states) re-establishes 
the classical limit for the complexity bound. Entangle- 
ment thus proves again being a fundamental feature that 
distinguishes quantum objects from classical ones. 

We wish to thank M. Bremner and M. Piani for their 
help in editing the manuscript. This work was supported 
in part by the FWF, the DFG, and the EU (IST-2001- 
38877, -39227, OLAQUI, SCALA). 



[1] R. J. Solomonoff, Information and Control 7, 1 (1964). 
[2] A. N. Kolmogorov, Probl. Inf. Transmission 1, 1 (1965). 
[3] G. J. Chaitin, Information, Randomness & Incomplete- 
ness (World Scientific, 1987). 
[4] C. H. Bennett, Internal J. Theoret. Phys. 21, 905 (1982). 
[5] W. H. Zurek, Nature 341, 119 (1989). 
[6] R. Schack and C. M. Caves, Phys. Rev. Lett. 69 (1992). 
[7] C. M. Caves, Phys. Rev. E 47 (1993). 
[8] J. Eisert and H. J. Briegel, Phys. Rev. A 64 (2001). 
[9] A. Berthiaume et al., J. Compute. System Sci. 63 (2001). 
[10] P. Vitanyi, IEEE Trans. Inf. Theory 47, 2464 (2001). 
[11] P. Gacs, J. Phys. A 34, 6859 (2001). 
[12] N. Bohr, Atomic Physics and Human Knowledge (Wiley, 

New York, 1958). 
[13] T. Yamakami, arXiv: quant-ph/0412172 (2003). 
[14] Adopting this scenario we arrive to a notion of complexity 

similar to that introduced in 
[15] This approach is close to Bohr's viewpoint that the quan- 
tum state is essentially an expression of an experimental 
scenario (l2^ . 

[16] C. H. Bennett, How to Define Complexity in Physics and 
Why (Addison- Wesley, Redwood City California, 1990), 
pp. 137-148. 

[17] Here and in the following we use the signs (~, <) when 



the relationships are expressed up to the leading order. 

[18] J. J. Vartiainen et al., Phys. Rev. Lett 92, 177902 (2004). 

[19] A. Y. Kitaev, Russ. Math. Surv. 52, 1191 (1997). 

[20] This, in fact, would again require to describe arbitrary 
unitary transformations. 

[21] Even though almost all states are complex, it is impossi- 
ble to prove that any given state is. This derives from the 
fact that the statement: "The complexity of the classical 
string uj is greater than N" is unprovable |22Tl . 

[22] G. J. Chaitin, Randomness and Mathematical Proof, Sci- 
entific American 232 (5) (1975). 

[23] M. A. Nielsen and I. L. Chuang, Quantum Computation 
and Quantum Information (Cambridge University Press, 
2000). 

[24] C. E. Mora and H. J. Briegel, arXiv: quant-ph/0412172. 

[25] By W and GHZ states we intend A r /qubit entangled 
states of the form, respectively, ( 1 0. . .01) + 1 0. . . 10) + ... + 
|1...00»/VlV and (|00...0) + |11...1))/V2. 

[26] This procedure succeeds with exponentially low proba- 
bility, but this is not relevant from our point of view: we 
are in fact interested in the description of the procedure, 
not in the time or resources needed to apply it. 



